THE MATRIX ANSATZ, ORTHOGONAL POLYNOMIALS, AND PERMUTATIONS 

SYLVIE CORTEEL, MATTHIEU JOSUAT- VERGES AND LAUREN K. WILLIAMS 

Abstract. In this paper we outline a Matrix Ansatz approach to some problems of combinatorial enumer- 
ation. The idea is that many interesting quantities can be expressed in terms of products of matrices, where 
the matrices obey certain relations. We illustrate this approach with applications to moments of orthogonal 
f**^ , polynomials, permutations, signed permutations, and tableaux. 
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The aim of this article is to explain a Matrix Ansatz approach to some problems of combinatorial enu- 
meration. The idea is that many interesting enumerative quantities can be expressed in terms of products 
of matrices satisfying certain relations. In such a situation, this Matrix Ansatz can be useful for a variety of 
reasons: 

• having explicit matrix expressions gives rise to explicit formulas for the quantities of interest; 

• finding combinatorial objects which obey the same relations gives rise to a combinatorial formula for 
the quantities of interest; 

• finding two combinatorial solutions to the same set of relations identifies the generating functions 
for the two sets of combinatorial objects. 

This Matrix Ansatz approach is not particularly new and has appeared in various contexts, notably in 
iq ■ statistical physics (see |HaNa83j , (K191J . |Fan92) . and [DEHP93 for a few examples). We will take this 

Q\ \ opportunity to illustrate its utility for some problems in combinatorics. 

\Q '. 

fvi . 1.1. The Matrix Ansatz and the ASEP. The inspiration for this article comes from an important paper 

of Dcrrida, Evans, Hakim, and Pasquier [DEHP93 , in which the authors described a Matrix Ansatz approach 

f-J , to the stationary distribution of the asymmetric exclusion process (ASEP), a model from statistical physics. 

This model can be described as a Markov chain on 2 n states - all words of length n in and 1 - where a 
1 in the ith position represents a particle in the ith. position of a one-dimensional lattice of n sites. In this 
Markov chain, a new particle may enter the lattice at the left with probability — tt, a particle may exit the 

lattice to the right with probability -z^tt, and a particle may hop to an empty site to its right or left with 
probabilities ^W and ^j respectively. See DEHP93 for more details. A main result of [DEHP93 was the 
C^ ' following. 

Theorem 1. [DEHP93 Suppose that D and E are matrices and (W\ and \V) are row and column vectors 
(not necessarily finite- dimensional) , respectively, such that: 

(1) DE = qED + D + E, a{W\E = (W\, /3D\V) = \V), (W\V) = 1. 

Then the steady state probability that the ASEP with n sites is in state (n, . . . ,r„) is equal to 

(W\W = i(nD + (I - n)E)\V) ^ 

where Z n = {W\(D + E) n \V). 



^ 
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Note that one does not lose any information if one forgets the denominator Z n , and simply keeps track 
of the un-normalized steady state probability (W\ T[i=i( T iD + (1 — Ti)E)\V). 

As an example, given D,E, (W\, \V) satisfying the conditions of this Matrix Ansatz, the un-normalized 
steady state probability that the ASEP with 5 sites is in state (1,0, 0, 1, 1) is (W\DEEDD\V). 

There are several remarks worth noting about Theorem [1] First, the theorem does not guarantee a priori 
the existence of such matrices and vectors, nor does it give a method for finding them. Second, one may find 
several very different solutions to the Matrix Ansatz. Third, in this case one does not need to find solutions 
to (P) in order to compute steady state probabilities: given any word X in D and E, one can keep applying 
the first relation of ([lj to express X as a sum of words of the form E k D , then use the other relations of ([1]) 
to evaluate this sum. (That being said, explicit solutions to ([T]) can be useful for a variety of reasons, as we 
will see later.) 

As we will explain in this article, there are many other interesting quantities that can be computed via 
relations similar to those of ([TJ. In a previous article CoWi07a , the first and third authors explored a 
combinatorial solution to (JIJ, finding an explicit solution D, E, {W\, \V) such that expressions of the form 
(W|X|V) enumerate certain tableaux of a fixed shape corresponding to X. As a consequence, this identified 
steady state probabilities of the ASEP with generating functions for tableaux. In the remainder of the 
introduction, we will explain this example in more detail. Subsequent sections will describe variations of the 
Matrix Ansatz and other combinatorial enumeration problems which fit into this framework. 

1.2. The Matrix Ansatz and permutation tableaux. 

Definition 1. A permutation tableau is a Young diagram whose boxes arc filled with 0's and l's such that: 

• each column contains at least one 1, and 

• there is no box containing a which has both a 1 above it (in the same column) and a 1 to its left 
(in the same row). 

We always take the English convention for Young diagrams. Permutation tableaux are a distinguished 
subset of Postnikov's J-diagrams [Pos06 , introduced in connection to the totally non-negative part of the 
Grassmannian. More specifically, if we drop the first condition above, we recover Postnikov's definition of 
J-diagram. 

Note that we allow our Young diagrams to have rows of length 0, and we define the length of a permutation 
tableau to be the sum of its number of rows and columns. Alternatively, this is the length of the southeast 
border of its Young diagram. The permutation tableaux of length n are in bijection with permutations on n 
letters |Pos06[ IStWi071 lBur071 ICoNa09j . See Figure [1] for two examples of permutation tableaux of length 8. 
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Figure 1 . Examples of permutation tableaux 



Before explaining the connection between the Matrix Ansatz and permutation tableaux given in CoWi07a , 
we need to define some statistics. A in a permutation tableau is called restricted if it has a 1 above it in 
the same column. An unrestricted row is a row that does not contain any restricted 0. A topmost 1 is a 1 
which is topmost in its column, and a superfluous 1 is a 1 that is not topmost. If T is a permutation tableau, 
let wt(T) be the number of superfluous l's, let f(T) be the number of l's in the first row, and let u(T) be 
the number of unrestricted rows minus 1. 

Label the southeast border of a permutation tableaux with D's and £"s going from North-East to South- 
West such that each South step is labelled by D and each West step is labelled by E. As the first step of 
the border is always south, we can ignore it, and encode the border of a permutation tableau of length n + 1 
with a word in the alphabet {D, E} of length n. The shape of a tableau of length n + 1 is the corresponding 
word in {D,E} n . Each corner of the tableau corresponds to a pattern DE in the word. For example, the 
word associated to the diagram at the left of Figure [2] is DDEDEED. 
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If X is a word in D and E. let 



Tab(A) 



j2q wt{T) a- fiT) r u{T \ 



where the sum is over all permutation tableaux T of shape X. 
We first claim that for any words X and Y in D and E, 

(2) Tab{XDEY) = g Tab(A£L>y) + Tab(XDF) + Tab(XEY), 

To see that this is true, look at the content of a corner box of a tableau of shape XDEY. It can contain: 

• a superfluous 1 , in which case the box can be deleted, leaving a permutation tableau of shape XEDY . 

• a topmost 1, in which case its column may be deleted, leaving a permutation tableau of shape XDY. 

• a (necessarily with only O's to its left), in which case its entire row may be deleted, leaving a 
permutation tableau of shape XEY. 

See Figure^] In all cases, the monomial associated to the smaller permutation tableau is easily described in 
terms of the monomial associated to the original tableau, yielding ([2]). 
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Tab(XDEY) = qTab(XEDY)+ Tab(X DY) + Tab(XEY) 
Figure 2. Decomposition of a permutation tableau 



We also claim that for any word X in D and E, 
(3) a Tab(EX) = Tab(A) and f3 Tzb(XD) = Tab(A). 

These relations are clear upon inspection. Comparing equations ([2|) and (J3]) to the equations of the Matrix 
Ansatz (|TJ), we see that the generating functions Tab(A) for permutation tableaux of shape X obey the same 
recursions as do the un-normalized steady state probabilities of the ASEP. Hence for each word X of length 
n in D and E, Tab(A) computes the (un-normalized) steady state probability of being in the corresponding 
state of the ASEP with n sites. 

Alternatively, one could concretely define the following matrices and vectors, with rows and columns 
indexed by the non- negative integers. Let D be the (infinite) upper triangular matrix (^i,j)i,j>o such that 
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otherwise. 



Let E be the (infinite) lower triangular matrix (IS, 



ij)i,j>0 



such that for j < i, 



E; 
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Otherwise, i?y = 0. Also let (W\ be the (row) vector (1, 0, 0, ... ) and | V) be the (column) vector (1, 1,1,... ) T . 
Then one can check that these matrices and vectors satisfy (JXJ) , and hence that (W]-X" |V) is equal to Tab(A). 
More specifically, one can think of D and E as operators acting on the infinite-dimensional vector space 
indexed by all permutation tableaux (of all shapes and lengths), where D acts by adding a new row of length 
and E acts by adding a new column at the left of an existing tableau, in all possible ways. See (Co Wi07a] 
for details. 

The upshot of both arguments is that the steady state probability that the ASEP is in state r is propor- 
tional to the generating function of permutation tableaux of shape Ili=i(' r «^-' + 0- ~ T i)E- Additionally, the 
second argument provides an explicit formula for this generating function, as a matrix product. 

We remark that there is a more general version of the ASEP in which particles enter and exit at both 
sides of the lattice, with probabilities a, /3,7, and 5, and there is also a tableaux formula for the stationary 
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distribution of this more general model CoWilO . However, this formula is considerably harder to prove 
than the special case described above; the methods described here are not sufficient. 



1.3. The Matrix Ansatz and Motzkin paths. Another solution to the Matrix Ansatz of Theorem Q] was 
given in [BCEPR06IIBECE00] , and is as follows. Let a = (1 - q)^ - 1 and f3 = (1 - q)l - 1. Define vectors 

(W\ — (1,0,0,...) and \V) — (1,0, 0, . . . ) T , and matrices D = (Aj)ij>o an d E = (i5i,j)»*7>o where all 
entries are equal to except 

(4) {l-q)D iji = l-pq i , (1- ? )% 1 =1-W, (l-q)E iii = l-aq i , {l-q)E i+lji = l-q i+1 . 

Recall that a Motzkin path is a lattice path in the plane with steps east (1,0), northeast (1,1), and 
southeast (1, 1), which starts at the origin, always stays at or above the x-axis, and ends at the x-axis. One 
often puts weights on the steps of a Motzkin path and then considers the generating function for all Motzkin 
paths of a fixed length. 

Note that if (W\ = (1,0,...), \V) = (1, 0, . . .) T , and D and E are tridiagonal matrices (that is, D^j — 
Eij — for \i — j\ > 1), then for any word X in D and E, the quantity (VF|A|y) is the generating function 
for all weighted Motzkin paths of length n and shape X = X\ . . . X n . By shape X, we mean that if Xj = D 
then the jth step of the Motzkin path must be a northeast or east step, and if Xj = E, then the jth step of 
the Motzkin path must be a southeast or east step. Furthermore, if the jth step of the Motzkin path starts 
at height i, its weight is: 

• D ii+ i if the step is northeast and Xj = D 

• E ii+ i if the step is northeast and Xj = E 

• Di : i if the step is east and Xj = D 

• Ea if the step is east and Xj = E 

• Dii-i if the step is southeast and Xj = D 

• Ei : i-\ if the step is southeast and Xj = E 

Moreover the quantity Z n = (W\(D + E) n \V) is the generating function for all weighted Motzkin paths of 
length n where the weight of a northeast (resp. east, southeast) step starting at height i is £>,,»+ 1 + •Ej.i+i, 
(resp. D ui + E iti , A,i-i + ^.i-i)- 

It follows that the above solution D, E, (W\, \V) to the Matrix Ansatz identifies steady state probabilities 
of the ASEP with generating functions for weighted Motzkin paths of the corresponding shape. 

Additionally, these Motzkin paths provide a link to orthogonal polynomials, via the combinatorial theory 
of orthogonal polynomials provided by |Fla821 IVie88) . More specifically, the moments of the weight function 
of a family of monic orthogonal polynomials can be identified with the generating functions for weighted 
Motzkin paths, where the weights on the steps of the Motzkin paths come directly from the coefficients of the 
three-term recurrence for the orthogonal polynomials. This will be explained more carefully in the following 
section. This allows us to interpret the partition function Z n = (W|(£) + E) n \V) of the ASEP with n sites 
as the nth moment of a family of orthogonal polynomials. Indeed, the solution of the Matrix Ansatz given 
here corresponds to the moments of the Al-Salam-Chihara polynomials. The link between the ASEP and 
orthogonal polynomials was first made in |Sa99) . Most of the time, when we define orthogonal polynomials, 
we will refer to the survey paper |KoSw98] . All the original articles are cited in [KoSw98 . 

This article is organized as follows. In Section [21 we recall some elementary facts concerning moments 
of orthogonal polynomials, and explain how the Matrix Ansatz sheds new light on some known examples, 
e.g. the connection between rook placements and Hermite polynomials. In Section[3j we apply this method 
to the enumeration of permutations, signed permutations, and type B permutation tableaux LaWiOSj, and 
we make a link with two different kinds of g-Laguerre polynomials. Finally, in Section 01 we show that 
the Matrix Ansatz gives rise to a new combinatorial interpretation of a generalization of Genocchi numbers 
defined by Dumont and Foata [DuFo76| . 

Acknowledgements: The third author is grateful to Ira Gessel for a useful conversation about orthog- 
onal polynomials. 



2. Orthogonal polynomials 

In this section we review some notions about orthogonal polynomials, in particular a combinatorial inter- 
pretation of their moments. We then revisit some classical results about orthogonal polynomials, illustrating 
the Matrix Ansatz approach. Note that throughout this section, we take (W\ — (1, 0, 0, ... ) and | V) = (VF| T - 

Definition 2. We say {Pk(x)}k>o is a family of orthogonal polynomials if there exists a linear functional 
/ : K[x) — > K such that: 

• deg(P fe ) = k for k > 0, 

• f(PkPt) = 0Hk^£, 

• f( p k) ¥= ° for k > °- 

The nth moment of {Pk{x)}k is defined to be /x n = f(x n ). 

It might seem that fi n depends on / and not just on {Pk{x)}k>o- But since f(P n ) = for any n > 1, wc 
can obtain the moments recursively from the initial moment hq. By convention we always take /Uo = 1. 
By Favard's Theorem, monic orthogonal polynomials satisfy a three-term recurrence. 

Theorem 2. Let {Pk{x)}k>o be a family of monic orthogonal polynomials. Then there exist coefficients 
{bk}k>o and {X k }k>i in K such that P k +i{x) = {x — b k )Pk(x) - X k Pk-i(x). 

By work of [Fla82, Vic88 , the nth moment of a family of monic orthogonal polynomials can be identified 
with the generating function for weighted Motzkin paths as follows. 

Theorem 3. |Fla821 rVie88j Consider a family of monic orthogonal polynomials {Pk(x)}k>o which satisfy 
the three-term recurrence Pk+i(x) = (x — bk)Pk(x) — XkPk-i(x), for {bk}k>o and {Xk}k>i in K. Then the 
nth moment fi n of {Pk(x)}k>o is equal to (W\M n \V) , where M — (jriij)ij>o is the tridiagonal matrix with 
rows and columns indexed by the non-negative integers, such that m^i-i — Xi, ma = bi, and rm^+x = 1. 
Equivalently, \x n is equal to the generating function for weighted Motzkin paths of length n, where the northeast 
steps have weight 1, the east steps at height i have weight bi, and the southeast steps starting at height i have 
weight Xi. 

The third author would like to thank Ira Gessel for explaining the following simple proof to her. 

Proof. Let us re-write the three-term recurrence as xPk(x) = Pk+i{x) + bkPk(x) + XkPk-i{x). Let P = 
(Pq(x), Pi(x),P2(x), • • • ) T be the vector whose ith component is Pi(x), Then the fact that the Pk(x) satisfy 
the three-term recurrence is equivalent to the statement that MP — xP. 

It follows that M n P = x n P. Let / be the linear functional associated to {Pk(x)}. Applying / to both 
sides gives 

(5) M n f(P) = f(x n P). 

We now analyze the first entry of the vector on either side of ([5]). Note that Pq — 1 so f(x n Po) = f(x n ) = /i„. 
And f(Po) = 1, so the first entry of the left- hand- side of ([5]) is equal to (W|M"|V). It is easy to see that this 
is equal to the generating function for Motzkin paths of length n, where the northeast steps are weighted 1, 
the east steps at height i are weighted bi, and the southeast steps starting at height i are weighted Xi. This 
completes the proof. □ 

The following remarks will be useful in subsequent sections. 

Remark 1. Given a tridiagonal matrix M, note that if we define another tridiagonal matrix M' — (m'^) 
such that m'u = m u and m' ll+1 m' l+ll = m,, l+1 m l+1 , l , then (W\M n \V) = (W\M' n \V). 

Remark 2. If {Pk(x)}k>o is an orthogonal sequence with moments {/x„} n >o, the shifted sequence {Pk{ax-\- 
b)}k>o with a,b 6 K and a ^ is also orthogonal, and its nth moment is ^^ =0 (fc)Mfc( — b) n ~ k . In 
particular, if fi n has the form fi n — (W\M n \V) , then the moments of the shifted sequence are (W|M' n |V") 
where M' = \{M-bI). 



2.1. Rook placements and g-Hermite polynomials. Let [n] q = 1 + q + . . . + q n 1 . One of the simplest 
classes of orthogonal polynomials are the "continuous big g-Hermite polynomials" , defined by the recurrence 



(6) 



xH n (x\q) = H n+ i(x\q) + aq n H n (x\q) 



jH n -i{x\q). 



When a = they specialize to the "continuous q-Hermite polynomials" , and in this case a combinatorial 
interpretation of the moments was given in |ISV87) in terms of perfect matchings and crossings. From 
Theorem [3l the moments are /i„ = (VF|M ra |y), where the matrix M has coefficients 



(7) 



m 4+M = 1, m M = aq\ m hi+1 = [i] q , rm,j = if \i - j\ > 1. 

We can write M = F + U where F is strictly upper triangular with 0's on the diagonal, and U is lower 
triangular. We can check that 



(8) 



FU - qUF = I, 



(W\U = a(W\, 



F\V) = 0. 



So we have a "Matrix Ansatz" for the moments \J\^. Indeed, just as permutation tableaux are described by 
the Matrix Ansatz of |T]), we can search for tableaux which are enumerated by products (W|X|F), where X 
is a word in F and U, and F and U satisfy the relations of ©. It's easy to see that (W|.X|V) enumerates 
rook placements in Young diagrams of "shape" X, where 

• there is exactly one rook per row, 

• a counts the columns without rook, 

• q counts each cell with no rook to its right in the same row, nor below it in the same column. 

And then since the moments /x„ of the continuous big g-Hermite polynomials are given by (W\(F + U) n \V), 
we recover results of |Var05] : ^ enumerates such rook placements in all Young diagrams where the number 
of rows plus the number of columns is n. 

There is a simple bijection between these rook placements and involutions on [n\. To obtain the involution 
from the rook placement, we label the steps in the southeast border of the Young diagram, and draw some 
arches as follows: for each rook lying in column i and row j, we draw an arch joining i and j. See Figure |31 
the rooks are represented by o. Under this bijection, a counts the fixed points, and q keeps track of a statistic 
called total crossing number defined in [MSS07] . This extends the case a = given by Ismail, Stanton, and 
Viennot JISV87J . 

We can also consider the Motzkin paths corresponding to the product /i„ = (W|(-F + U) n \V). There is a 
simple bijection between these paths and involutions. This was given in Pen95 in the case a = 0, and in the 
present case with a general, Penaud's construction can be adapted so that horizontal steps in the Motzkin 
paths correspond to fixed points in the involution. See Figure |3] for a rook placement, the corresponding 
involution, and the corresponding Motzkin path. The weighted Motzkin path is obtained from the involution 
as follows: the ith step is /*■ if i is the smallest element of an arch, it is — > with weight aq k if i is a fixed 
point with k arches above it, and it is a step \ with weight q k if i is the largest element of an arch (j, i) 
and there are k arches (it, v) such that j < u < i < v. 
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FIGURE 3. A rook placement, the corresponding involution and weighted Motzkin path. 



2.2. — 1 Tableaux and a q-analogue of Charlier polynomials. The Stirling numbers appear as 
moments of Charlier polynomials. We consider here the q-Charlier polynomials defined by de Medicis, 
Stanton, and White in MSW95 as a rescaled version of Al-Salam-Carlitz polynomials, with the recurrence 
relation 



(9) 



xC n (x,a;q) = C n+1 (x, a; q) + (aq n + [ri\ q )C n (x,a;q) + a [n] q q n C n -i(x,a;q). 
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From the same reference we know that the nth moment of this sequence is X)fc=i a Sq( n > k) where S q (n, k) 
is the Carlitz g-Stirling number, satisfying the relation 

(10) S q (n, k) = S q (n - 1, k - 1) + [k] g Sg(n - 1, fc). 

A combinatorial interpretation of S q (n, k) was given by Leroux in |Ler90 . A — 1 tableau is a filling of 
a Young diagram with 0's and l's such that there is exactly one 1 in each column. Then S q (n,k) is the 
generating function for — 1 tableaux with n — k columns and k rows, where q counts the number of 0's 
above a 1. 

Let us explain how we can reproduce Leroux's combinatorial interpretation via the Matrix Ansatz method. 
From the recurrence relation, the moments of the g-Charlier polynomials are [i c n = {W\M n \V) where the 
tridiagonal matrix M has coefficients 

(11) m i+ i t i = [i + l] q , m iti = aq l + [i] q , m iti+ i = aq l , m^j = if|i-j|>l. 

We can write M = aX + Y where X and Y do not depend on a. These matrices satisfy the relations 

(12) XY -qYX = X, (W\Y = 0, X\V) = \V). 

The Matrix Ansatz method shows that with these relations, (W|(a-X" + y)™|V) is a generating function of 
— 1 tableaux. Indeed there is a recursive decomposition of — 1 tableaux associated with the relation (|12l) , 
in the same way that permutation tableaux are associated with the relations (TTJ). So the method explains 
why these tableaux appear as moments of the g-Charlier polynomials. 

2.3. Rook placements and another g-analogue of Charlier polynomials. Another g-analogue of 
Charlier polynomials was defined by Kim, Stanton, and Zeng in [KSZ06] as a rescaled version of Al-Salam- 
Chihara polynomials. The recurrence is: 

(13) xCl{x, a; q) = C* +1 (x, a; q) + (a + [n] g )C*(x, a;q)+a [n] q C^_ x (x, a; q). 
The nth moment is \x c n — (W]M|V), where M has coefficients: 

(14) m i+ ij = a, m^i = a + [i] q , rm,i+i = [i + l]g, rn itj = if|i-j|>l. 

Let F = {fi,j)i,j>o and U — {ui,j)i,j>o be such that /i,j+i = [i + l] g and Ui+i,j = 1, all other coefficients 
being 0. We can check that M = (U + I)(F + al) where F and U are the matrices defined above (for the 
g-Hermite polynomials ) satisfying FU - qUF = I. From \f~ = (W\((U + I)(F + aI)) n \V), the Matrix 
Ansatz method gives a combinatorial interpretation of the moments in terms of rook placements. Indeed, in 
the expansion of ((U + I)(F + al)) n , each term m corresponds to the choice of some columns and rows in 
the staircase Young diagram, and (W\m\V) counts the rook placements with no free row or column of shape 
m. So we can see that \x c n counts the rook placements in the staircase Young diagram of length 2n, possibly 
with empty rows and columns, and q counts the number of inversions, i.e. cells having a rook below and a 
rook to its left. 

A simple bijection links these rook placements with set partitions so that q counts the number of crossings 
and a counts the number of blocks. This result was first given in [KSZ06 . Motzkin paths in this case are 
known as Charlier diagrams [KaZe06] . See Figure 0] for an example of a rook placement, the corresponding 
set partition it — (1, 5, 7)(2, 6)(3,4), and the Charlier diagram. The set partition is obtained from the rook 
placement as follows: we label the inner corner of the Young diagrams with integers, and for any rook at 
the intersection of a column with label i and a row with label j we draw an arch from i to j. Each block 
of the set partition is given by a sequence of chained arches. The weighted Motzkin path is obtained from 
the set partition in the following way. The ith step is /~ with weight a if i is the minimum element of a 
non-singleton block, it is — > with weight a if i is a singleton block, it is — > with weight q k if i is the minimal 
element of an arch and the maximal element of another arch (j,i), and it is \ with weight q k if i is the 
maximal element of an arch (j, i) but not the minimal element of another arch. Here k is the number of 
arches (u, v) such that j < u < i < v. 
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Figure 4. A rook placement in a staircase diagram, a set partition, and a Charlicr diagram. 



3. Permutations and signed permutations 

3.1. Permutations and inversions. De Medicis and Viennot |MeVi94J studied a g-analogue of Laguerre 
polynomials (with one parameter set to 1), whose nth moment is the classical q- factorial [n] q \. They are a 
particular case of the little g-Jacobi polynomials. The recurrence relation is: 

(15) xL n (x) = L n+1 (x) + q n {[n] q + [n+l] q )L n {x) + q^^L^x). 

Recall that an inversion of a permutation 7r is a pair {i,j) with i < j and n(i) > tt(J). We denote the 
number of inversions of it by inv(ir). It is well known that 

F n (q) := J2 q mvM = W~ 

TT£S n 

Proposition 1. Let W and V be vectors, and D and E be matrices, satisfying 

(16) {W\V) = l, D\V)=E\V) (W\E = {W\, DE = qED + D. 
Then the generating function F n (q) is equal to {W\D n \V}. 

To prove this, we will use certain tableaux contained in shifted Young diagrams. 
Definition 3. We equip the set S:={(i,j)6NxN | i < j} with the partial order: 

{hi) > (i'>j') if an d only if i > i' and j > j' . 
A finite order ideal of S is called a shifted Young diagram. 

See the left of Figure [5] for an example of a shifted Young diagram. 
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Figure 5. A shifted Young diagram and inversion tableaux 



Proof. Consider — 1 tableaux contained in shifted Young diagrams such that each cell of the main diagonal 
contains a 1 and any cell that contains a has only 0's above it. See the diagrams of Figure [5l Then there 
is a simple recurrence for such tableaux of a given shape, that corresponds to the relations of Proposition 
[TJ Therefore (W|.D ra |V) enumerates such tableaux of staircase shape (n,n — 1, n — 2, . . . , 1). We call such 
tableaux contained in a staircase shape inversion tableaux. 

Label the columns of an inversion tableau from 1 ton from right to left. Then there is a bijection between 
inversion tableau and permutations, such that the number of superfluous l's in column i corresponds to the 
number of inversions of w(i) (i.e. the number of j > i such that n(i) > 7r(j')). Indeed the sequence of the 
number of superfluous l's in column i = 1, . . . , n is the inversion table of the permutation. For example, the 
tableau in the middle of Figure [S] gives the inversion table (2, 2, 0, 1, 0) and the permutation (3, 4, 1, 5, 2) and 
the tableau on the right of Figure [5] gives the inversion table (2, 2, 2, 0, 0) and the permutation (3, 4, 5, 1, 2). 
This proves the proposition. 



Note also that the following vectors and matrices satisfy the Ansatz: 

E{ t i — Ei t i + i = [i + l] q , Eij — otherwise, 

A,i-i = q l [i\q, Dis = q l {\i] q + [i+ l] q ), A, 4 +i = q l [i + l]q, Aj = otherwise, 

and (W\ = (1, 0, 0, . . .) and \V) = (1, 0, 0, . . .) T . Therefore {W\D n \V) is the generating function of weighted 
Motzkin paths of length n with weights A.; = q 21 ^ 1 ^ + l] 2 and 6; = g l ([i] 9 + [i + 1] 9 ). This is known to be 
the generating function of permutations counted by inversions. See for example [Bi93]. □ 

3.2. Permutations and crossings. 

Definition 4. |Cor07| A crossing in a permutation 7r is a pair (i,j) such that 

• i < 3 < 7r(i) < 7r(j) or 

• i> j > ir(i) > ir(j). 

They appear in the combinatorial interpretation of the moments of Al-Salam-Chihara g-Laguerre polyno- 
mials [KSZ08 . These are another (/-analogue of Laguerre polynomials whose recurrence relation is: 

(17) xL*Jx) = L* n+1 (x) + (y[n + l] q + [n] q )L* n (x) + y[n] 2 q L* n ^(x). 

See [SS96J for some generalizations of these polynomials. 

Proposition 2. CoWi07a The generating junction of permutations of size n enumerated according to their 
crossings is 

(W\(D + E) n \V) 
with 

(18) (W\V) = l, (W\E = Q, D|V) = |V), DE = qED + D + E. 

Proof. One can easily check that (W\(D+E) n \V) is the generating function of permutation tableaux of length 
n where q counts the superfluous l's, using the same arguments as the ones developed in the introduction. 
See [CoWi07a , and also [JoslO , for proofs. From IStWi07j we know that permutation tableaux of length n 
with j superfluous l's are in bijection with permutations of [n] with j crossings. 

One can also prove the result with a solution of the Matrix Ansatz. Indeed the matrices D and E with 
entries given by 

A,i = [i+ l]g, A,i+i = [i + l]q, D UJ = otherwise, 
E iti = [i] q , E iti _i = [i] q , E itj = otherwise, 

<^| = (1,0,...), \V) = (1,0,...) T 

are a solution. Therefore (W|(.D + E) n \V) is the generating function of weighted Motzkin paths of length 
n with weights A.; = [i] 2 and bi = ([i] q + [i + l] q ). This is known to also be the generating function of 
permutations counted by crossings jCor07| ISS96J . □ 

3.3. Signed permutations. A signed permutation of {1, . . . , n} is a sequence of integers (?r(l), • • ■ , n(n)) 
such that — n < n(i) < n and U™ =1 |7r(£)| = {1, ...,n}. For example (2,3,7,-5,6,1,-4,8) is a signed 
permutation of {1, ... , 8}. Let B n be the set of signed permutations of {1, ... , n}. 

We extend the definition of crossings of permutations to signed permutations: 

Definition 5. A crossing of a signed permutation n = (7r(l), . . . , 7r(n)) is a pair (i,j) with i,j > such that 

• i < 3 < ^(i) < 7r(j) or 

• —i<j< — 7r(f) < 7r(j) or 

• i> j > 7r(i) > ir(j). 

Remark 3. Note that if for all i, Tt(i) > 0, then the crossings of the signed permutation are the same as the 
crossings in Definition @] for usual permutations. Moreover if for all i, n(i) < 0, then the crossings of the 
signed permutation are the same as the inversions of the permutation (— 7r(l), . . . , — 7r(n)). This notion of 
crossing has the nice property that the number of signed permutations of [n] with no crossings is ( ™) , the 
Catalan number of type B, just as the number of usual permutations of [n] with no crossings is the Catalan 
number of type A, see |Wil05j . 
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Definition 6. LaWi08] A type B permutation tableau of length n is a filling with O's and l's of a shifted 
Young diagram of shape A = (Ai, A2, • • • , A&), where Ai < n, such that: 

• Any on the main diagonal has only O's above it. 

• There is no with a 1 above it and a 1 to its left. 

• Each row has at least one 1. 
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Figure 6. Permutation tableau of type B 

These tableaux are in bijection with signed permutations, and are related to a cell decomposition of the 
totally non- negative part of a type B Grassmannian [LaWi08 . 

An example is given in Figure [6] Note that we allow rightmost columns of length 0. We will label the 
southeast border of a tableau with Z?'s and E's, writing a D (resp. E) whenever we go along a vertical (resp. 
horizontal) step. This word in D's and E's encodes the shape of the tableau. 

Let B n (q,r) be the generating function of permutation tableaux of type B of length n, where q counts 
the superfluous l's and r counts the l's on the main diagonal. 

Proposition 3. The generating function B n (q,r) is equal to 

(W\(D + E) n \V) 

where 

(19) (W|V) = 1, (W\E = {W\, D\V)=rE\V), DE = qED + E + D. 

Proof. We illustrate a recursion for the generating function for type B permutation tableaux of a fixed 
shape, which mirrors the relations above. First, the generating function of the tableaux of length is 1 : 
this corresponds to the fact that (W^F) = 1. Second, a bottommost row of length one must contain a 1 on 
the main diagonal. This row can be deleted, which corresponds to D\V) = rE\V). Third, any column of 
length at the right can be deleted, which corresponds to (VF|-E = (W\. Finally each corner box (which 
corresponds to the subword DE in the word encoding the shape of the tableau) contains either: 

• a superfluous 1, so this box can be deleted (leaving a tableau whose shape has the DE replaced by 
ED, and whose weight is equal to the old weight divided by q) 

• the unique 1 in its row, and consequently the row and column containing the main diagonal cell to 
its left can be deleted (+D) 

• a 0, and consequently its column can be deleted (+E). 

See Figure [7] for an example. □ 
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Figure 7. Decomposition of permutation tableaux of type B 
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Theorem 4. There exists a one-to-one correspondence between signed permutations in B n with j crossings 
and £ minus signs and permutation tableaux of type B of length n with j superfluous 1 's and £ l's on the 
main diagonal. 

in 



Proof. This result is analogous to a result proved for usual permutations and type A permutation tableaux 
[Cor071 IStWi07] , and we can prove it using an argument analogous to that given in [StWi07j . Indeed, we use 
the bijection from [LaWi08, Section 10], which in turn was an adaptation of the bijection from StWi07 . We 
then apply the same arguments that were used in Section 3 of [StWi07J to show how the statistics translate 
under this bijection. 

One can also prove the preceding result with a solution of the Matrix Ansatz. Indeed 

A,j = A, i+i = [i + 1] ? , Aj = otherwise; 

Ei,i-i = \i] q (l + rq l ), E hl = \i] q (l + rq l )+rq l [i + l] q , E iti+1 = rq l [i + l] q , E hJ = otherwise, 

w = (i,o,...), |^) = (i,o,...) T , 

is a solution. Therefore (W\(D + E) n \V) is the generating function of weighted Motzkin paths of length n 
with weights A, = [i + l]g(l + rq l )(l + rq l+1 ) and bi — (1 + rq l )([i] q + [i+ l] q ). On can adapt the proofs in 
|Cor071 ISS96] to show that this is indeed the generating function of signed permutation in B n according to 
crossings [QjKWlOj . D 

From the weights on the Motzkin paths, we see that the generating function for signed permutations of 
size n where q counts the number of crossings, is the nth moment of the orthogonal sequence P n {%) T \ q) or 
simply P n (x) defined by the recurrence: 

(20) xP n (x) = P n+1 (x) + ([n + l] q + [n],)(l + rq n )P n {x) + (1 + rq n )(l + rq^^n^P^^x), 

with P-i(x) = and Po(x) = 1. We have the following two special cases for these orthogonal polynomials 
(which are the counterpart of combinatorial properties given in Remark [3|). 

• When r = 0, we recover the recurrence relation for the Al-Salam-Chihara q-Laguerre polynomials 

• When we keep only the terms of maximal degree in r, we recover the recurrence relation for the little 
g-Jacobi Laguerre polynomials L n (x). 

These P n (x) can be linked with some classical polynomials called continuous dual g-Hahn polynomials in 
KoSw98 , denoted by R n (x; a, b, c \ q) or simply R n (x). Their recurrence relation is 

(21) 2xR n {x) = R n+ i{x) + (o+ I - (A n + C„)) R n (x) + J 4„_ 1 C n i?„_i(a;), 
where 

(22) An = i(l - abq n )(l - acq n ) and C n = o(l - q n )(l - bcq 71 ' 1 ). 
In the case where a = 1, b = — r and c = q, one has 

(23) A n + C„ = -(l-q)([n] q + [n + l] q )(l+rq n ) and A n -±C n = (I - q) 2 (l + rq n )(l + rq n - 1 )[n] 2 q . 
Hence, 

(24) P n {x- r\q) = j^R n {x^ + 1; 1, -r, q \ q) , 

and we can see P n (x) as a special case of these continuous dual g-Hahn polynomials. 

4. Genocchi numbers 

Dumont and Foata introduced in [DuFo76 a three-parameter generalization {/„ (a, b, c)} n >i °f the Genoc- 
chi numbers, defined by /i(a, b, c) = 1 and 

(25) f n +i(a,b,c) = (a + b)(a + c)f n (a + 1,6, c) - a 2 f n (a,b,c). 
When the parameters are set to 1, / n (l, 1, 1) is the Genocchi number G2n+2 defined by 

oo 2n 

(26) £^1^1= *•**(!)■ 



n=l 



It is straightforward to see that /„ has non-negative coefficients, but it is more difficult to prove that /„ is 
symmetric in a, 6, and c |DuFo76] . And while several combinatorial interpretations of f n (a,b,c) have been 
given |Dum74[ IDuFo76| [Han96, Vie8l], none of them readily exhibit the symmetry in a, b, c. 



The goal of this section is to give a new combinatorial interpretation of f n (a, b, c) in terms of alternative 
tableaux [Vic08], and to use this combinatorial interpretation to give a simple proof of the symmetry in a, b 
and c. This is done by using the link with moments of continuous dual Hahn polynomials, and the Matrix 
Ansatz for alternative tableaux. 

The continuous dual Hahn polynomials S n (x) are defined by the recurrence : 

(27) xS n (x) = S n+ i{x) + (An + C n - a 2 )S n {x) + A n ^xC n S n -i(x), 
where: 

(28) A n = (n + a+b)(n + a + c) and C n = n(n + b + c - 1), 

and S-i(x) = 0, Sq(x) = 1. (Up to a sign they are the same as the ones defined in |KoSw98j .) Zeng 
Zcn96, Corollaire 2] has given a continued fraction for the generating function ^2 n>0 f n (a, b, c)x n . This was 
conjectured by Dumont and also proved by Randrianarivony, see details in :Zen96|. From this continued 
fraction and the recurrence (|27p we see that f n (a,b,c) is the nth moment u* of the orthogonal sequence 
{S k (x)} k >o- 

Thus we have f n (a, b, c) = (W|M™|V) where the matrix M has coefficients: 

(29) M M = Ai + Ci - a 2 , M l+hi = A h M;_ M = Q. 

Using the bijection of Corteel and Nadeau [CoNa09 , it can be checked that permutation tableaux of 
staircase shape are linked to Dumont permutation of the first kind Dum74 , which were introduced to 
give a combinatorial interpretation of Genocchi numbers. These permutations are the a £ &2 n such that 
a(i) > a(i+l) if and only if cr(i) is even for any 1 < i < 2n (with the convention that a(2n + l) = 2n + l). Via 
the bijection, the shape of the tableau is obtained by examining the values of the descent in the permutation 
so that the result follow easily. Thus, Genocchi numbers counts the permutation tableaux of staircase shape. 
Alternatively, we could use the bijection of Steingrimsson and Williams |StWi07| . which links staircase 
permutation tableaux to Dumont permutation of the second kind |Dum74| : indeed, these permutations are 
the a € &2n such that o~(i) < i if and only if i is even, and via the bijection the shape of the tableau is 
obtained by examining the weak exceedances of the permutations. 

So it is natural to compare this matrix M with the product DE of the matrices D and E of the PASEP 
Matrix Ansatz defined in (Q| . The limit when q = 1 of these matrices are well-defined, and a straightforward 
computation show that DE + (c — 1)(D + E) is equal to M, under the condition that a = f3~ l and b = a -1 . 
So, knowing that f n (a,b,c) is symmetric, we have: 

f n (a, b, c) = (W\M n \V) = (W\(DE + (c- l)(D + E)) n \V) = (W\(ED + cD + cE)) n \V). 

The last equality is obtained by using the fact that DE = ED + D + E. We can derive a new combinatorial 
interpretation of / n (a, b, c) in terms of permutation tableaux. 

We will also use alternative tableaux, which are slightly different objects. As remarked in |CoNa09"] . all 
the entries of a permutation tableau can be recovered if one knows the position of the topmost l's and the 
rightmost restricted 0's. Viennot Vic08l INa09] took this a step further and defined alternative tableaux, 
which are partial fillings of Young diagrams with as and /3s such that any cell to the left of a j3 (resp. 
above an a) is empty. There is a direct bijection from permutation tableaux of length n + 1 to alternative 
tableaux of length n (essentially one replaces topmost l's with as and rightmost restricted 0's with /3s and 
makes all other boxes empty and deletes the first row). Alternative tableaux are interesting in this context, 
because they are more symmetric than permutation tableaux, and consequently more adequate to explain 
the symmetry of the polynomials / n (a, b, c). 

Theorem 5. The polynomial (a/3j) n f n (a'~ 1 ,l3~ 1 , r y~ 1 ) counts the staircase alternative tableaux of length 
In, where the parameters a, j3, 7 follow these statistics: 

• the number of cells containing a a, 

• the number of cells containing a f3, 

• the number of corners which does not contains a a or a f3. 

Equivalently, (a/3j) n / n (a _1 , fi~ l ,7 _1 ) counts the staircase permutation tableaux of length 2n + 2, where the 
parameters a, (3, 7 follow these statistics: 

12 



• the number of 's in the first row, 

• the number of restricted rows, 

• the number of corner which contains a superfluous 1 . 

Proof. When 7 = 1, we can use the results from CoWi07a which have been recalled in the introduction of 
this article, and it follows that (W\(DE) n \V) counts the staircase permutation tableaux of length 2n + 2, 
where the parameters a^ 1 , /3 _1 counts the number of l's in the first row and the number of unrestricted 
row. When we replace DE with ED + j~ 1 D + j~ 1 E, in the recurrence relation for permutation tableaux we 
see that 7 -1 will count the corners containing a restricted or a topmost 1. So in (a^j) n f n (a~ x , ft' 1 , 7 _1 ), 
the parameters a, ft, and 7 counts the complementary statistics which are given in the theorem. □ 

In this combinatorial interpretation, the symmetry in a and ft is apparent, because we can transpose the 
tableaux to exchange the two parameters. The symmetry in 7 and ft is obvious from the recurrence relation 
(|25|) . so this implies the full symmetry of the three parameters. The symmetry in 7 and ft can also be proved 
by an explicit involution |Josll) . 

We can ask if there is a direct bijection between staircase alternative tableaux and other known combina- 
torial interpretations of / n (a, b, c). In particular, Viennot }Vie81| gives a combinatorial interpretation which 
has also an apparent symmetry exchanging two parameters, which can be defined as follows. We consider 
pairs (/, g) of maps from [n] to [n] such that f(i) > i and g(i) > i for any i, and such that for any 1 < j < n 
there is at least an i such that f(i) = j or g(i) — j. The three statistics are: 

• u{f, g) is the number of i such that f(i) = i , 

• v (f>9) is the number of i such that g(i) = i , 

• w {It9) is the number of i such that f(i) = n plus the the number of j such that g(j) = n. 

The we have f n {a, b, c) = J2(f q) a u ^' B ' x b'"^ ,9 ' x c w ^' g ^~'' 1 . There is an obvious symmetry in a and b but it 
seems to be different from the symmetry which is apparent on the permutation tableaux. 

If we examine the general case where q ^ 1, it appears that (W\(qED + cD + cE) n \V) is not symmetric 
in a and 7. To obtain a refinement of f n (a,b,c) or (aftj) n f n (ct^ 1 , /3 _1 ,7 _1 ) it might be interesting to 
consider the continuous dual g-rlahn polynomials R n (x;a,b,c \ q), defined in (|21[) . Let g n (a,b,c,q) be the 
nth moment of the polynomials -R n (f — l;a,b,c\ q). Let 

a = (1 — q)a — 1, b = (1 — q)b — 1, and c = (1 — q)c — 1. 

Then we have that g n (a, b, c, q)(l — q)~ 2n is a polynomial, symmetric in a, b and c, which specializes to 
f n (a,b,c) when q — 1. This just confirms that these q-Hahn polynomials are a q-analog of the Hahn 
polynomials. Unfortunately the polynomial g n (a,b,c,q)(l — q)~ 2n contains negative terms. However we 
have the following result when one parameter is set to one, for example a = 1. 

Theorem 6. The moment g n (—q,b,c,q)(l — q)~ 2n is the generating function for staircase permutation 
tableaux of length In + 2, where q counts the superfluous 1 's, b counts the number of 1 's in the first row 
except one of them, and c counts the number of unrestricted rows except the first row. 

Proof. This generating function of permutation tableaux is (W\(DE) n \V) where D and E are the solution of 
the PASEP Matrix Ansatz. By writing the product explicitely we can check that M — DE has coefficients: 

(1 - q)M iti = (1 - 5<f )(1 - ftq') + (1 - cW)(l - q t+1 ), 
(l-, Z )A/ l+M = (l- ( f+ 1 )(l-/3<f+ 1 ), 

(1 - q)M u+1 = (1 - aftq l )(l - aq 1+1 ). 

Hence (W\(DE) n \V) is the nth moment of an orthogonal sequence where the three-term relation can be 
derived from the coefficients of the matrix M, and by comparing it with the coefficients of the recurrence 
(f2"TT) we can derive the result. □ 
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